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ABSTRACT " 

Several techniques havGi been developed for creating 
continuous smooth *distributioiis of test jiorms/ This paper describes 
two studies that explore the behavior of dubic spline's in order to 
^determine their appropriateness for use in test «orming^. The first 
study uses data from the Curriculxun. Referenced T^iests of Mastery 
(CRTM) and employs two smoothing techniques in determining 
distributions' of percentile ranks (PR) • Methqd ^1 calculated PR values 
from cumulative f reqiiency c<^nts of rSw. scores values and then 
smoothed them to create a jsontinuous distribution. Method 2 ^oothed 
the r^w frequencies to create the continuous distribution. The second 
study was designed to generate a theoretical jpopulatipn, sample 
repeatedly from it, and smooth^ the results in a comparative study of 
the two ..procedures . Both studies showed that spline sjnoothihg 
techniques are ^ convenient and economical, procedure for analytically 
smoothing\test score distributiohs and generally give good results. 
T'he second study found that, of the methods, method 2 'produded better 
results andT was more robust' with regard to the choice of smoothing 
parameter. Both methods %were easy^ efficient and. economical to use. 
Statistical tables of ^standard deviations and means are included. 
(EGS) r : . " ^ / ' 
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Pay choroetrlciana have developed, a variety o£ , tedKniquea for 
creating coriblhuouA. aaooth dlatrlbutiona . to nor* and equate teat data.' 

Ango£f<1971) and Kolen<1983) have r|vlewed aoae of t^eae itechnlquea. 

-> ■' ° ■ ' ■ ■. ■■'-''"v ..V-, . ';■ .. • ' / 
For example, /hand smoothing fiermLta direct control o£ the adherence ^Of 

the function to tKe frequency dlatrlbutlon. but la" not analytical ^ In ^ 

nature and la therefore ■lll-aulted for computer a^ 

Traditional linear Iriterpolatlon la uaeful for determlnln(g Intermediate 

valuea of a function but la not helpful In fell«li?atlng Irregularltlea V, 

- ' ^'^if'. ■ ■ ■ ■'■ ■ ■ ■"' " 

cauaed by sampling ert^r or^ teat unrellabiUtyl £ Specific functlona ^" 

<e.g., logistic and quadratic) have,, been augg^oted by MarcoCl^?'?). and'. ' 

* ■ ■ ^ • ■. '•■*.> 

■ . ■ . V * - • ■ • . ' ' 

Lindsay and Prichard<1971) 1:6 fit aetfl p£ data; . While these procedui^ea 
do lend themaelvea to computer appUcatlona. • one muat , a^aume' . that 'ithe 
furtctionol^ form of the equation aatl^tfactpi^lly flta; the dat^^ 
Reaearchera familiar with' Item reaponae theory are weU awa^re that the 
exact form of the function uaed to fit a given set of data can engender 

• substantial conttfoveray. ' ■ .. ^ 

If the functional form' of the equation is ^pt needed; >« gfn^al 
analytical curye-flttlng procedure permitting, the creation of a. 

continuous, smooth dlatribution la u.^eful. Furthermore, it la ^deairable ' 

• . ..... " ■*■ ' 

to be abl^e to control the amoothneaa of that • rfiatribution by aome eaaily 

apecifiabie parameter. Kolen<l'9d3) ha^- found cubic apline snio^lng 

procedurek to be effective in 1^ smqgjthing of equipercentile equating 

functlona. Theae procadurea are very general, however, arid can be, uied 



to amooth a variety » of functions regardleaa of the ahape of 
diatributlon. Spline . techniquea are' uaed in fielda aa diverae aa 
ahipbuilding (Theilheimer and Starkweather^ 1961) and aatronomy (Jonea^ 
1973/ 1977) but have not be^ frequeptly applied in paychometrica. Two . 
paychometric uaea are found in- their applicationa in multidlmenaional 
acaling (Winaberg and Ramaey^ 1^1) and teat equating (Kolen/ 1 983). If 
one teat ia to be equated to another .it may be neceaaary to create a 
continuoua diatribution in order to approximate ability levela that are 
not diacrete. ^Furthermore^ amoothing of acore diatributiona may be 
deairable to approximate the diatributioh of the population from which 
acorea are aaaumed to have been aampled. For theae applicationa cubic 
apline curve fitting techniquea appear to be well-auited. 

Deacription "of Cubic Sm^oothing Splinea 
For some time polynomial curvea' have been uaed to create ^continuoua 
diati;lbutiona for aeta of diacrete data. , The primary drawback to auch 
procedures ia that a ^ aubatantial number of ^terma muat be incorporated tp 
fit the obtained, data polnta. Aa the number theae pointa increaaea^ 
ao in general doea the order 'of the polynomial. RelatjLyely amall 

changea in or<*lnate valuea of diata pointa can lead to aubatantial 

■ ' » 

changea in polynomial coef f icienta. Moreover^ the need to incorporate 
large-order polynomial terma leada to additional, cbmpiitational 
inatability. The problema encountered in the Xiae of polynomial 
approximationa therefore tend to ^make them a leaa . attractive aolution to 
curve fitting than might be expected. 

An alternative procedure ou^ined in Ahlb^g^, Nilaon and 
Wtflah <1967) ia to connect piecewiae polynomial aegmentet >uch that many 



short ^aegmenta of aome vSpeclCled functional form are joined at locationa 
'^^^^Miiiflik^^^^ the, ^ anaiyati. Thia procedure -g^ea • a great ' dear more 
i^ cu)5v^ fitting aince one ^.ay connect points with linet- 
fhoae functional form ia relatively aimple while maintaining 
_ o. fit coi^plex curve^. The simpleat example 6t this fitting 

'^'^^^^B^t ' ' ■ • ) • ■ •w- . : 

cechniqflnu in the uae of continuous piecewiae linear^ line aegmenta for 
the purpoise of interpolation. However^ piecewiae linear functiona are 
inaccuro^ for curvilinear aityatipns^ ' p^articularly iti regions df 





subiBtajIgHb, curvature . «uch as'might be expected near the extremea of 
cumulative ^frequency diatributiona. . * ^ * 

Although theae piecewiadf segments, may take oh any of a number of 
functional forma^ in practiiqe-^^ piecewiae cubic polynomiala are frequently 
uaed becauae they displ)^' certain optimal propertiea auch aa niinimum 
curvature (Ahlberg et al^% 1967) wh^le retaining aV relatively aimple 
form. The minimum curvature property is predicted by a theorem of 
Holladay and is useful since it avolda the problema of oscillatory V 
functions aometimea encountered in fitting a single polynomial to^^a^ 
large number of data pointa. /The entire collection of piecewiae 

■ ■ . , . ' . ■ V" ■ * * • 

■ 0 » 

function'a ia called a apline; the pointa at* which the line aegmenta are 

joined are called *knota or ducka. Iii order to diaplay the optimal 

propertiea deacribed. above^ the piecewiae aeg)nenta are aubjected to 

.f . 

< ... 

aeveral reatrrctions# - phe of .vwhich is that the firat ^and second 
'derivativea must be. continuous at^the knota (i.e. the valuea of/ the 
first and second derivati^^ea pf the curve must be identical at the knot 
regardleaa of the apline aegment on which they are eyaluated). . 

. DeBo6r(197d) and Reinach(1967) have discussed the use of smoothing 
splines. In t-hese procedures a spline consisting of piecewise 
pol>^omiala ia fitted to th^ data aa above but a certain amount of 



latitude /lA permitted in the fit of the curve to the d^ta. Whereas the 

^ «' / . • * ' . • • . 

prdcediirea. outlined by Ahlberg et ai. reatbict the ordinate vaiue of the 

* i ■ ' . 

curve at the knotp to the- obtained data vaiuea, the fitted vaiue-. is ^ 
permitted to deviate from these values in smoothing splines. The 

amount of this departure is controlled by the specification' of a 

■■ ' *. . ■' 

smoothing parameter called E in this paper. A value of E=0 implies 

'that the cubic spline is pimply a spline of Interpolation consisting of 

^ / ' " 

segments of cubic lines joined at the knots^ the procedure outlined in ^ 

z ■ * ' 

Ahlberg et al. A larger value of E specifies the extent to which the 
'function is allowed to deviate from the obtained data points. The* 
limiting value of E is determined* 'by the total deviation sum of squares 
of the data points from 'a straight line fitted to, the data points and in 
its limiting^ case ^ the spline simply becomes a straight line. 

The spline function S<x) is evaluated by determining £he J^)cations 
of the knots^ x. , representing score points in £his paper. The value 
of the spline function for a given value x then represents the ordinate 
value of the distribution undergoing smoothing (i.e.,' percentile rank^. i 
observed frequency^ etc.). Using the notation of Ahlberg et al. we have 



S(x) 



6 hj 6 hj 6 ' hj ' . ■ 

9 , ^ • . <1) 

. " 6 . hj ■ ■ • 

where h. = x . - x . , the length of the. Interval of Interpalatlon; 

D 3 .. D-1 ., • # 

< X < X j ; dhd the values of Mj- are determined by solving the 

■ • 



X 

following equation: 
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defined aa , ■ ^1+^ 
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Here 



la defined aa 



1 -X. . 



and d . la defined as 



■ 6 { ( yj-n - yj)/ ^i-n - ( yj - yj-i)/ hj j . ' . 

' hj + hj_i . * ' • 

The- . are referred to' aa momenta of the apllne function and are 

aeccmd derivatives of the function evaluated at the knots. Since the 

^ ' ■ * ■ '■ \^ ' * ^ ' * 

X. and y . are known In . thia application, the entire system of 
equations may beVsolved through the use -of well-developed, efficient 
^recursion* techniques^ / ' 

While Holladay'a theorem requires that f<x > * V fP^* all x 
in practice this restriction is not necessary. Instead pne may impdse 



some minimisation requirement on the function: this can dcine by 

requiring a ' least- squares s 
data points or by restricting 



requiring a least-squares solution for a spline with .fewer knots than 

n ' 

the spline becomea the smoothing apllne mentioned above. 



. - S<x . )]^ < E. 

/ . 1 - - 



The use of spline functions represents an analytical-^^ procedure 
which combines flexibility of form, replic^bility of cutve-f ittirig ; 
techniques, and computational eas^ with a subjective , element ^which 
permits the analyst to control the fit' of tbe curVe. Rather than prior. 
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apeciflcation of several valueia in a range generally found to 

provide «an good blend of curve f ib and '«moothneaa may be tried bef ore 
choosing the value giving the beat reaulta. Comparing the amoothed 
curve and the original *diatribution on^the same graph for aeveral valuea 
of E may aaaiat in t.he Selection oif E. Interpolated valuea of the aplinef . 
function Can be iiaed for computer plotting within the a^me program which 
calculated ' the valuea of the amoothing function at the knots. 

Determination of the optimal amoothing range ia largely a matter of 
experience when tlTe ahape of the true diatributi<^>!rt% unknown. Reinach 
auggeata restricting E to the interval N - v52N>\ <' E < N ♦ /:2N) where 
N represents the number of possible scores. For an 80 item test« this 
places E between' 68 and 94. However, as Kolen (1983) points out, 
Reinsch assumed that, the y wcfre * independent # an assumption not met 
when smoothing a curve of cumulative f requencies, for' example. In 

practice, the optimal value of E depends on the sh^pe of the curve being 

* . ■ » : ' 4 ' ^ 

amoothed, the error within the sample (which is in part a function of 

the ^ number of sub3ects sampled) and the size of the y . Optimal 

values of B will differ for cumuldtive frequencies and cumulative 

relative frequencies. . > ' 4 

The evaluation^ of. the splin^ function can be carried out through 
use of For ti^an -callable subroutines a^ailabl^ through IMSL<1982X or by 
use of deBoor's (1978) subroutines SMOOTH, SETUPQ, AND CHOLID. The 
latt^ procedures w^e used in(^the analyses described in this paper. 
They are well-documented, appear to be quite robust^ and easily 
modifiable by the user; furthermore they are quite economical and are 
easily transported from institution to institution. 

In the present study smoothing splines were developed . for 



diatributiona o£ percentile rahka by two methoda. In Method I, the PR 
valuea were determined f ron cumulative frequency counta of raw • acore ^ 
valuea and then amoothed^ creating a continubu^ diatribution of PR 

• • • ^' • ^ 7 

valuea. In Method 2, the caw frequenciea^ were amoothed to create a 

continuoua diatribution. The area under the curve waa then determined ^ 

, ■ *» 

by integrating (1) to obtain the following: 



Xj_i . ■ 24 . 24 hj • 24 hj ' 2 - 



'""^ 2hj 



(3) 



where xj-i < x o ^ ^ j ^^^^ ^-j ^ 7^ j-l * * and- y are 

defined aa before. When x ^ ^ x . thia aimply reducea to 

0 3 ^ . 



(4) 



Thia latter area ia eaaentially the area of a trapezoid with a cubic 
corire'ction for curvature. * After integrating the' entire curved the area 
under the curye ia normalized to lOQ. If 0 repreaenta the loweat 
poaaible acore^ k^^^ the higheat^ . and x any ac^fQ on tAe ' interval 



r Six) dx • 

^ y inn 



• / S(x) 'dx 
repreaenta th^ PR for a aubiect with a acore of x. 

Thia paper repreaenta ah attempt to explpre the behavior, of cubic 

aplinea in ordeir . to determine their appropr j,ateneaa for uae in teat 

norming. Two atudiea were carried out:' th.e f irat explorea the 

feaaibility of the uae of apline functiona for data obtained in norming 



the Currlcuiunt Referenced Teata of Haatery <CRTM> (Sabera and S€ibera«\ 
1984). Bec^uae auestlona were, raiaed concernlnq which of the twb 
amoothlng techniq.uea more cloaely approximated the ^populations from, which 
the data were aamDled^ a aecond Monte Carlo "Study waa deaigned to 
generate a theoretical 'population^ sample repeatedly from it, and amooth 



the results in a comparative study.. 
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■ ••■/.. ■ . ■ . ■ • ■. • • . 

■. V . ■ ■ , ■• - 

^ . : study One i ^ 

Methodology: 

Initial explorations of the behavior of cubic apllne functions were 
' <• * , • > ' 

made using data from the Fall^ 1982^ administration of prototype 

^ ■^r 

mathematics and reading tests of the CRTM, The prototype testa' vfere 

- ■ •* . • • 

administered .both on* and off*level to samples of 300 to 400 (Students 
per teat. Grade levels of booklets and students ranged from first to 
eighth' grade. Opce the authors were familiar . the behavior of cubic 

splines ^ splines were used to smooth 40 distributiona resulting from. the 
Winter^ ^ 1983^ administration of standard reading and mathematics tests 
on- and off -level to samples of 3000 to 4000 - students, i 

' The two smoothing procedures described previously were .used oh the 
prototype teats ;^ appropriate values for th^ smoothing parameter E were 
determined for each distribution and procedure and the results compared 

f or ' ;problem8 ^sln curve fit. Because the criterion distribution la 

. • • * • - . ■ 

unknown^ it * is not possible to determine which method better 

approximates the true distribution of PR values. 

\- • : A ' 
'<■ . ^ * . ' • * 

Results and. Discussion: 

' > - ■ ' ■ • "' • ■ 

Results for Method 1 appeared quite good; small irregularities in 

PR distributions were effectively removed and with^proper attention to 

the values of the smoothing parameter^ shooth distributions were 

obtained* Values of E which appeared |appropriate for the Fall prototype 

tests ranged between 10 and 50. Discernible differences in smoothed 

test score distributions wer^ noted only for increments in E of five or 

more^ so relatively few analyses^ were n||i^ded to obtain a satisfactory 



dlatrlbutlpn in moat cases. ^\ ^ 

Little smoothing was required , for the Janiiar.y norming of the^ 
standard testa. With -repr^entative nationar samples of cyver 3000 
students^ PR distributions were quite smooth. ^ For the- sake of^ 
uniformity in reporting norms, all values of E were set to zero (i.^., ' 
no smoothing, inteil^polation oAly) and spline functions were used t^ 
determine intermediate values for subsequent test equating. .Because 
CRTM standard 'test norms are often used, as a basis ^'f or r4portvlng nor^ms 
on custom CRTM Teats, it is imperative that PRs be available for ^6^- 
integer scores. 

Two difficulties arose; when using Metho^d 1 for non-zero valueh of 
E. First, when several anomalously high oir low frequencies appe^ar close 
together, the spline function ia ineffective in smoothing out the 
anomaly. Increasing values of E. can cause the smoothing procedure to 
have minimal'* impact on regions needing etmoothing ^while having greater 
impact on regions needing less smoothing. Second, end values of the 
spline function tended to depart from the asymptotic values of 0 and- 100 
with iijcreasing values of E, a result of the tendency^f the function to 
approach a leaat-aquarea line. T^la reaulted in PR valiiea greater tlxan 
100 or leiss than 0; ^ . 

.< ' * . * . ■ 

Method 2 was developed to solve the problems mentioned a:bove. 

* .» . ' ■ * 

Since frequencies, unlike cumulative f requencieia, represent independent^ 
observations, it was/ hoped that the impact of several ' anomalous 
successive values could be \inimized. ^Although a sl'ight improvement was 
noted in using Method 2 the problem was not totally solved. A potential , 
solution to the problem lies in the use of ^ viariable length intervals 
between data points;^ i.e., binning data 'in such a way that the impact of 
\oo-large. or too-small* frequencies is minimized. Still another 



potentlalj aolution Ilea in thie uae of leaat-aquacea aplinea rather than , 
amoothing aplijieia. Subaequent atudiea are planned to examine theae 

^procedures. ' ' • . 

V The second problem . noted^ ^ the non-aaymptotic ends of. ^ the 
diatrilDUtion, ^waa solved by ^the aecond prqcedure. Occaaional negative 
amoothed frequencies were noted' 'near the extrei|ies of the distribution 
with the smaller samplea in the Fall testing; hut this is 'unlikely "^to 
occur when the number of subjects is large. It ahould alao' be noted 
that with amall numbera of aubjecta and amall valuea of E the apline 
function eatablished ^ in the either procedure ia occasionally not - 
monotonic. ' - ~ ' " 

^Appropriate values of E for Method 2 were aiibatantially larger than 
for the firat procedure. Although appropriate valuea in Me^thod 1 ranged 
between 10 and 50 for tests containing 50 to 80 it^ma, the valuea for 
Method 2 ranged between 300 and 700. This is due in part to the 
substantial differencea in the appearance of the curvea being amoqthed 
in each method and these differences are of no consequence In the 
evaluatibn of the two methods. 

Both methods produced very good, usable results. Because the 
procedure is analytical, consistent results were obtained in smoothing 
data distributions while substantially reducing the time and expense of 
smoothing and interpolating diatributions. 

■ ■■ ' ■• ■ « ■ 

« 



# • 

■w * 



study Two . y - 



t^e^hodology: 



While cubic aplinea were found to be jan -effective am'oothing^ 
procedure in SJ:udy One atid while Method 2 appeared to ' give alightly 
better reaulta in amoothitig teat data« the goal in amoothing - a ' 
diatribution ia ;to remove irregularitiea to approximate the teat • score 
distribution in the parent^opulation. Since nothing^ ia known about the 
parent population except that which can be generalized from a aampler^ it 
'ia not poaaible uaing atudent aample data to determine which of the two 
methoda more cloaely approximatea the actual diatribution of teat scorea 
in" the population. To anawer thia queation^ a Monte Carlp atudy waa 
undertaken. 

The following aaaum^tiona of true acore theory were made: 

1. X = t ♦ e, the obaerved acore is the aum' of a true acore and 
an error acore. ' v 

2. oj' - + oj-. \ the obaerved acore variance iia the aum of true 
acore variance and error acore variance. 

3. = ( 1 -p )a ^ error acore variance is a function of observed 

6 XX X ' ■ 

scbre variance and te^ reliability .P^- 




Diatributiona of obkervecl acore valuea were aimulated by aampling 400 
pairs of randoA normal daviateal Setting = 1^3^ =^ ^6 and, * 12* and 

letting 2^ arid 22 repreaent thd -pair of random normal deyiatea* obaerved 
acore valuea were computed according to the following formula: --^ 

XX 



= ( 12 zi + 35 ) + . 12' ,1 ^_ 0 Zo 

^ XX ^ 
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Item valuea were then groupeii^lnto discrete categories with a -1- 

■ ♦ ■ • • ^> • ■ 

ppint interval. The resultii^ distribution <|^s then smoothed by the two 

methods ■ described previously and smoothed PR <PR g J values were 

compared With the PR values for a normal <PR ^ ) distribution v»ith a \ 

mean of 36 and •^true-acore standard deviation of 12. by calcujl^ting the 

value'of the total fit ^ror/ aaj below: 

» * 
'n » . • 

T = 'I ^PR - PR )^ , ' <5) ' 

i=l ^ 

The amoothi^ procedure which yield'a the loweat value, of T ia preabmed 
to give the cloaeat fit fbr the aet of data under conaideration. While ' 
thia ia the procedure actually employed in thia atudy^ othera could be 
used' depending on the needs of the analyat. 

The values of T are not directly comparable until ojptimal smoothing 
(minimizing the value' qf T) has been carried out for each smoothing 
proce<lure. To determine the value of E which minimizes T, IMSL 
subroutji^e ZXGSN was used. The method employs a golden section search 
procedure <IMSL, 1982) which assumes that a function has a unique minimum 
within the range, of values linder consideration. For - smoothing 
procedures local minima rather than a unique minimum value may be 
encouhtered. The failure to find a unique minimum results from 
differing , values of E causing a function to. approximate more closely 
the criterion in one region while causing it to' depart from the 
criterion in another. However,' since T is compared for the two 
smoothing procedures, if the procedure which failed to converge produces 
a local minimum 'anywhere for which T is less than the procedure which 
converged, we may assume the procedure with the unknown absolute minimum 
yields better results for the, given data set. In the present study. 



Method 1 always converged to a minimum. Reflulta for Method 2 were mdre 
Variable. Vheae reauita and their implicationa are diacuaaed . below. 

Valuea-^f o uaed in the atudy were 1.00 <no meaaurement error)^/ 
0.91 -{reliability comparable^ with that of many well atandard^zed 
achievemejg£lv t®flta currently available)/ and^ 0.74 (permitting . 
incorporation of aubatantial errora of meaaurement). For each value ^of 
p ^fifty aamplln^' diatributic^na were eatabliahed. By apecifying the 



XX 



aame 



initial aeed value^ the diatributiona were reatricted to the a^me 



aampliW valuea acroaa; the three values of p * . Thua • reaulta for'. 

amoothing the firat di^eribution at p . = 4.00 may be compared with 

XX , ■ ■■ J • 

amoothed 'jreaulta of the aame distribution at p = 0.91. Differing 

\ . .y ' 

valuea of T in theae diatribulf/ona are due to the relative magnitude of 

• ■ . ' ■ ■ ■ • . . ■ 

meaaurjement errora. / * ' * 



Reaylta and Di^cuaaion: ^ 

Tablea 1, 2, and 3 preaent the valuea of T and optimal aj^oothing 
valuea of E ^ for the two procedurea at p = 1.00^ 0.91 and 0.74 

I reapectively. For compariabn with and T ^ ^ the aummed . aquared 

deviationa T of the unamoothed PR valuea from the PR valuea for a 
normal diatribution are alao preaented in each table in column 6. 
Theae vary over the three diatributiona becauae of tKe relative 
contribution of meaaurement error to the procedure. Aateriaka denote 
valuea of E which failed to converge to a minimum.- 

In every caaeNwith either Method 1 or Method 2^ the amootlied Veault 
better approximatea the given normal diatribution than doea the 
unamoothed diatribution indicating that the two analytical amoothing 
procedurea are at leaat partially aucceaaful in recovering the 
diatribution from which they were aampled. While in aome caaea the 



improvement may not be auBatantiai; in othera overall deviationa are 
markedly reduced. Figure 1 preaenta reaulta of one auch amoothing at 
s l.OO. ' Here deviationa from the normal diatribution for Method 1 are 
repreaented by a star; deviationa for Method 2 by a triangle and 
deviatiopa for the^ unamoothed diatribution by a aolid line. The 
corz^esponding valuta for the sample (#41> for * T2 * and Tq 

representing the summed squared deviationa are 20.89 « 19.5*4 and; 65.90 
Veapectively. For thia aet of amootjied^reaulta, marked improvement 
can be o^aerved fdrr either method and the effecta of aampling error are 
dlearly dimihiahed. 

For p = 1.00 Method 2 yielda better 'results than Method 1 in 

approximately ' half the caaea although in general reaulta from thb two 

■ • 

procedures are quite cloaeCaee Table 1). Thia indicatea that the exact 
smoothing procedure chosen for a highly reliable teat may be of leaa 
importance than the fact of amoothing itaelf. Aa tlie unreliability ' ' [ 
the teat increaaea,* the superiority of Method i2 to Method 1 in terms of 
minimizing the error becomes more apparent. When 0.91, Method. 2 

givea better ^results than Method 1 in 76H of the caaea (aee Table^/ 2). 
Although reaulta are generally fairly cloae (as in Sample #1 for which 
T-j^ and * T2 equal 51.90 and 50.89 reapectively)^ sometimes the 
discrepancy is greater (as in Sample"^ #32 for which the corresponding 
values were 96.38 and 84.40). When p^^ = 0.74 the discrepancy between 
the two procedures becomes more substantial (see Table 3). Method 2 is 
clearly aui^erior to Method 1 in all but four of the caaea. In three of 
theae ^our, convergence to an optimal amoothing parameter did not occur 
(in fact, it did not occur in moat caaea of Method 2. at thia 
reliability). > With choice of another minimization procedure it ia 



poaaibla that low6r values of ^ "^i would be found for at leaat aom^ 

» ' ' * , . \' 

of theae values. V 

One effect which' atanda oiit auite aharply ia that aa teat 

reliability decreaaea, the smoothing^ procedure losea its effectiveness 

in recovering .the original normal diatributiori. ^ Compariaon of 

diatributiona for a given . r^un over the three reliabilities ahowa that, 

as expac:ted, the net effect of Ineaaurement ejrror ia a^lattening of the 

entire / diatribution of test scores . yielding a ' more ^ qplatykurtlc . 

diatribution. At the aame time, aome of the larger aampling anomaliea 

are amoothed -out.' . Therefore^ ' meaaurement . error in itself haa ^a 

smoothing effect; furthermore, once the distribution systematically 

departa from t^e original; aa happena when the diatribution ia 

flattened, both smoothing procedurea loae their efficacy in recovering 

the original diatribution. Ror thia reaaon, apline' amoothing procedurea 

cannot be expected to compenaate for poor teat reliability.' - ^ 

Meailai-fiilt^^^ * "^o' ^' and t are 

J- " ' '■••f'^^T ■. ■ . ' ' ■ , ■ ' ^ . • 

displayed in Table 4. Several con.cluaiona are readily apparent in theae 

tab^lea. . . ' 

^ 1. While fiverage sizes of and are cloae for P ^^^^ = * 1.00, 
values diverge a^ p^^ decreaaea with T ^ ^-i • 

2. The avefage size of the smoothing parameter tenda to decreaae 
' aa reliability decreaaea regardleaa^ of the smoothing procedure 

chosen. 

. ■ '> 

3. As reliability decreaaea, the uae of cubic spline ^aii^othing 
procedurea loaea ita ef f ectiveneaa in reatoring the ahape of the 
original diatribution. 

4; ^he variances of T^, 7^, and T^ increaae aa reliability 
decreases. 



:^ and E^Ve c: 



5. The varirancea c£ and ^ decrease aa reliability decreaaea. 
• • ♦ • " • ' • • ■ ■- ' • 
Thejse reaulta^ therefore^ confirm the conclualona baaed on examination 

of reaults of Individual* runa preaented in Tablea 1; 2, ^nd 3. 

The failure of the convergence procedure for Method 2 in moat caaea 



when o / =s 0.74 ahould not be conaidered a . weakneaa* but rather a 

atrength. It can be noted that deaplte the failure of the mlnlmizatijp^ 

V . • ^ • . j 

procedure to find an cTptimal amoothlng parameter^ Method 2 generally 

gave * auperlor reaulta for the value of E aelect^. In fact* tiiere 

exlata.a range of ° amoott^lng values which can be expected to yierd\. good 

reaulta. Jtj ahould also b^ noted that failure tp converge la a weakneas 

of the golden section search method* hot the amoothlng procedure. With 

test data* the optimization procedi^rj^ used in this section could not and 

would not be uaed. ' :\ 



Concluarona 



Both studies showed that spline^ smoothing techniques are a 
convenient and economical piM>cedure for analytically smoothing test 
score distributions and generally give good results. Method 2; the. 
method of integration; was developed in response to two probleme( - 

' ■ ■ ■ v ■ ■ \. ' ' ' ■ r 

encountered in Method 1 — the occurrence of several successively low op 
high values on the curve which proved resistant to smoothing, and the 
tendency of the ends of the distribution to jlepart fro^^j^^^e horizontal. 
Method 2 improved the .first problem and essentially eliminated the 
second.' " 

In the Monte; Carlo study it was found that both ' smoothing 
procedures give similar results for highly reliable tests < p = 1.00) 
but as measurement error increases. Method 2 is found to give better> 
resu^s. Neither procedure was completely effective, however, in 
restoring the shape of thcj original distribution once measurement error 
had systematically changed the curve. ' 

Optimal smoothing parameters tended to vary substantially from 
sample to sample. However, when a test is highly reliable, a larger 
smoothing parameter may well be necessary because the measurement error 
is not present to smooth out the effects of sampling error. Generally, 

Method 2 is quite . robust with respect to the choice of smoothing 

I . 
parameter. For Method 1 the choice may be more critic?al and confined to 

a rather ^ narrow range of values. 

Because Method 2 generally gave results as good as or superior to 

Method 1 and because it was more robust with regard to the choice of 

smoothing parameter. Method 2 should be used whenever apprppriate. 



However/ either method may be expected to give good reaulta, 
particuiariy when testa are li'eliable, and both are eaay« efficient, and 
economieai to uae. \ , > ^ . 
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Table' 1. Devl^itlona from No/mal Distribution for Each Smoothing M^hod 
and Comparison Deviations for No 'Smoothing (T^ ^^'^o '* ^0 ^' Optimal 
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indicates value of E2 'which faileB to converge to a minimum. 
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Table 2. Devlatlona from Normal Distribution for Bach Smoothing 
Hetho<l.and Comparison Deviations for No Smoothing <T and T >; 

Optimal Smoothing Parameter Values (B i and B2 >• » c).91. --^ 
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* 'indicates value of which failed to converge to a minimum. 
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TAbla' 3. ^;^Deviatlona from Normal Diatribution for Bach Smoothing 
Method and Comparison Deviations for ^No SaS^othlng XT ^ ^T^ , and 
Optimal Smoothing Parameter Values (B ^ and E2 >• p = 0.74^' 
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indicates value of which failed to converge to a minimum. 
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Table 4, Means and Standard faeviationa of Ti/, J 2 * «nd To/ (Svimmed 
Squared, Errors) and Ei and E2 (Smoothing Parameter Values)^ for Each 
Reliability. . V 
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= 0.74 
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n = 50 
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